Training Spiking Neural Networks with Metaheuristic Algorithms
نویسندگان
چکیده
Taking inspiration from the brain, spiking neural networks (SNNs) have been proposed to understand and diminish gap between machine learning neuromorphic computing. Supervised is most commonly used algorithm in traditional ANNs. However, directly training SNNs with backpropagation-based supervised methods challenging due discontinuous non-differentiable nature of neuron. To overcome these problems, this paper proposes a novel metaheuristic-based method for by adapting temporal error function. We investigated seven well-known metaheuristic algorithms called Harmony Search (HS), Cuckoo (CS), Differential Evolution (DE), Particle Swarm Optimization (PSO), Genetic Algorithm (GA), Artificial Bee Colony (ABC), Grammatical (GE) as search carrying out network training. Relative target firing times were instead fixed predetermined ones, making computation function simpler. The performance our approach was evaluated using five benchmark databases collected UCI Machine Learning Repository. experimental results showed that had competitive advantage solving four classification datasets compared other algorithms, accuracy levels 0.9858, 0.9768, 0.7752, 0.6871 iris, cancer, diabetes, liver datasets, respectively. Among CS reported best performance.
منابع مشابه
Metaheuristic Optimization Algorithms for Training Artificial Neural Networks
Training neural networks is a complex task that is important for supervised learning. A few metaheuristic optimization techniques have been applied to increase the effectiveness of the training process. The Cuckoo Search (CS) algorithm is a recently developed meta-heuristic optimization algorithm which is suitable for solving optimization problems. In this paper, Cuckoo search is implemented in...
متن کاملComparing Evolutionary Strategy Algorithms for Training Spiking Neural Networks
Spiking Neural Networks are considered as the third generation of Artificial Neural Networks, these neural networks naturally process spatio-temporal information. Spiking Neural Networks have been used in several fields and application areas; pattern recognition among them. For dealing with supervised pattern recognition task a gradientdescent based learning rule (Spike-prop) has been developed...
متن کاملMetaheuristic Algorithms for Convolution Neural Networks
A typical modern optimization technique is usually either heuristic or metaheuristic. This technique has managed to solve some optimization problems in the research area of science, engineering, and industry. However, implementation strategy of metaheuristic for accuracy improvement on convolution neural networks (CNN), a famous deep learning method, is still rarely investigated. Deep learning ...
متن کاملAdversarial Training for Probabilistic Spiking Neural Networks
Classifiers trained using conventional empirical risk minimization or maximum likelihood methods are known to suffer dramatic performance degradations when tested over examples adversarially selected based on knowledge of the classifier’s decision rule. Due to the prominence of Artificial Neural Networks (ANNs) as classifiers, their sensitivity to adversarial examples, as well as robust trainin...
متن کاملTraining Deep Spiking Neural Networks Using Backpropagation
Deep spiking neural networks (SNNs) hold the potential for improving the latency and energy efficiency of deep neural networks through data-driven event-based computation. However, training such networks is difficult due to the non-differentiable nature of spike events. In this paper, we introduce a novel technique, which treats the membrane potentials of spiking neurons as differentiable signa...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Applied sciences
سال: 2023
ISSN: ['2076-3417']
DOI: https://doi.org/10.3390/app13084809